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Introduction 

A  spectral  estimator  referred  to  as  the  G-spectral  estimator  was  intro¬ 
duced  by  Gray  [4]  and  by  Gray  and  Foster  [5] .  It  was  then  studied  in  some 
detail  by  Gray,  Houston  and  Morgan  [6].  The  estimator  was  based  upon  an 
approximate  G^-trans£orm  (see  Gray,  Houston  and  Morgan)  of  the  sample  auto¬ 
correlation  function  and  is  equivalent  to  an  e^-transformation  [11]  of  the 
same  function. 

Gray,  Houston  and  Morgan  (GHM)  noted  the  estimator  to  have  some  useful 
properties  but  noted  some  shortcomings  as  well.  In  particular  it  required 
more  autocorrelation  values  than  seemed  necessary  and  included  no  satis¬ 
factory  way  of  selecting  the  proper  value  n  in  the  e^-transform,  GHM 
went  on  to  conclude  that  an  ARMA  spectral  estimator  would  probably  have 
better  properties  than  the  G-spectral  estimator  which  they  had  studied. 

In  this  paper,  we  wish  to  give  a  modified  definition  of  the  G-spectral 
estimator  which  will  be  seen  to  avoid  the  difficulties  noted  by  GHM,  and 
will  in  fact,  be  shown  to  be  equivalent  to  a  method  of  moments  ARMA  spectral 
estimator. 

Definitions  and  Theorems 

The  e  -transformation  has  a  rich  history  and  has  been  studied  in  de- 
n 

tail  in  numerous  places  (see  for  instance  Shanks  [11]  and  Wynn  [12],  and 
for  its  application  to  complex  sequences  McWilliams  [9]).  We  define  the 

For 

e  -transform  formally  as  follows, 
n 

Definition  1.  Let  {f^^}  be  a  sequence  of  complex  numbers  defined  for 


m  *  -k,  -k+1,  . . . 


and  let 
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F  =  I  f. 

”  j=-k  3 


We  then  define  for  m  >  n-k-1,  n  >  1 
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whenever  the  indicated  division  is  defined.  Otherwise,  e  fF_)  =  e  ,  (F  ,) 

n  m  n-1  m-1 

We  define  e.CF  )  =  F  . 

u  m  m 

When  considering  ARMA  processes,  a  natural  class  of  sequences  to  con¬ 
sider  is  the  class  of  sequences  eventually  satisfying  a  linear  homogeneous 
difference  equation  with  constant  coefficients.  For  ease  of  reference,  we 
make  the  following  definition. 


Definition  2.  Let  {fj}  be  a  sequence  of  complex  numbers.  We  say  {f^}  is 
an  element  of  L(n,s,A)  if  n  is  the  smallest  whole  number  for  which  there 
exists  an  integer  t  and  complex  numbers  > •  •  •  such  that  f^  " i"*’* 
^^f^  n*  ^  all  j  >  1.  We  then  take  s  to  be  the  infimiom  of  all  such  1. 

If  f j  *  0  for  j  >  s  and  f^  0  then  we  say  {f^}  is  an  element  of  LC0,s,A). 
For  k  finite,  it  is  well-known  that  if  {f^.}  is  an  element  of  L(n,s,A), 

then 

I 

j«-k 

if  and  only  if  all  of  the  solutions  to  the  algebraic  equation  (called  the 
characteristic  equation) 

♦  (r)  «  1  -  (jt^r  -  . r"  ■  0 
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are  strictly  outside  the  unit  circle. 

eo 

Assuming  only  that  J  (f.(  <  «  numerous  results  are  available  giving 
j=-k  J 

sufficient  conditions  for  to  speed  up  the  rate  of  convergence  of 

,  In  particular  the  following  exactness  result  is  well-known. 


Theorem  1.  If  {f^}  is  an  element  of  L(n,s,d)  and  all  of  the  roots  of  ^(r) 
are  outside  the  unit  circle,  then 


e„(F  )  =  y  f. 
n'-  m"^  ,  i 

3=-k  J 


for  all  m  ^  s,  provided  k  is  finite  and  is  defined  (i.e.,  provided 

m  >  n-k-1) . 


Proof.  The  proof  for  {f^j^}  a  real  sequence  is  given  in  GHM  and  the  proof  for 

{f^}  a  complex  sequence  follows  in  the  same  manner. 

Noting  that  for  a  wide-sense  stationary  real  stochastic  process,  the 

spectral  density  can  be  expressed  as 

00 

S((D)  s  1  +  2  y  p(j)  COS(2TI(i)j)  , 

j=l 

Gray  was  led  to  consider  applying  the  e^- transformation  to  the  sequence 
{f^}  defined  by 

l,m *  0 

^  ~  (I) 

™  2p(m)  cos(2irum),  m  ^  1. 

k 

If  {X(t)}  is  an  ARMA  (p,q)  process,  {pCm))  is  an  element  of  L(p,q,d) 
from  which  it  follows  that  {p(m)  cos(2tr(i»m) }  is  an  element  of  L(p  +  n(ai), 
q' (A)  where  0  £  nCoi)  £  p.  Thus,  if  one  knows  (or  has  estimated)  the 
order  of  the  process  {X(t)},  it  is  natural  to  replace  o(m)  in  (1)  by  p{m) 
and  then  to  perform  an  -transform  on  the  sequence  thus  obtained. 

The  result  of  this  procedure  is  the  GHM  version  of  the  G-spectral  estimator. 
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When  the  G-spectral  estimator  was  originally  proposed,  there  was  no 
adequate  method  available  for  choosing  the  order  (p,q)  of  the  process. 

That,  in  conjunction  with  the  fact  that  the  order  of  the  difference  equation 
satisfied  by  the  sequence  given  in  (1)  changes  with  frequency,  necessitated 
that  essentially  a  different  model  be  chosen  at  every  frequency.  This  made 
the  procedure  extremely  cumbersome  to  implement  and  also  required  additional 
smoothing  of  the  resulting  estimate.  Furthermore  since  n((o)  is  typically 
equal  to  p,  a  larger  number  of  autocorrelations  was  required  in  the  estimate 
than  seemed  necessary. 

Gray,  Kelley  and  Mclntire  [7]  proposed  a  method  for  determining  (p,q) 
based  upon  the  so-called  R-  and  S-arrays.  This  procedure  makes  the  order 
selection  procedure  tractable.  The  procedure,  which  is  unambiguous  if  the 
true  autocorrelation  function  is  known,  has  been  shown  to  be  robust  to 
stochastic  disturbance.  In  addition,  other  methods  for  determining  (p,q) 
have  been  proposed  such  as  AIC  [1]  or  BIG  [2].  However,  in  this  paper  we 
will  make  use  only  of  the  Gray,  Kelley,  Mclntire  method. 

For  those  readers  unfamiliar  with  the  method,  the  theoretical  S-array 
is  given  in  Table  1  for  an  ARMA  (p,q)  process.  The  procedure  then  consists 
of  choosing  p  and  q  so  that  the  sample  S-array  best  matches  the  theoretical 
pattern. 

As  an  alternative  to  the  sequence  given  in  (1)  it  now  appears  more 
sensible  to  use  the  sequence 

f|^  »  exp(2iri(jam)  p (m)  ,  m  =  -k,  -k+1,...,  (2) 

where  k  is  chosen  to  be  positive  and  larger  than  p-q-2.  In  that  case,  {f  } 

m 

will  be  an  element  of  L(p,q,d)  for  all  frequencies.  From  Theorem  1,  taking 
{f^}  as  in  (2),  it  is  innediate  that  if  p(m)  is  the  autocorrelation  function 
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of  an  ARMA  (p,q)  process  and  {f^}  is  given  by  (2),  then 

OS 

.  f.  for  all  m^q  . 

J=-K  j 

Thus  the  spectral  density  sCoi)  is  given  by 


s(u)  =  2  Real  ^  ™  i  *1*  (3) 

V 

where  F.  =  7  f.  . 

j=-k  •’ 

From  the  discussion  given  above,  the  following  modified  definition  of 
the  G-spectral  estimator  should  appear  natural. 


Definition  3.  Let  sCu)  be  the  spectral  density  of  a  wide-sense  stationary 

A 

stochastic  process  and  oCj)  an  estimate  of  its  autocorrelation  function. 
The  order  (n,m)  G-spectral  estimator  is  then  defined  as 
„C.)  »  2  Real  (e„(F^-F„)  .  1 


where 


and 


V 

■  I  exp(2iri(i)j)  p(j-),  v  =  -k,-k+l,... 
j=-k 


k  >  max(0,n-m-2) . 

We  will  show  below  that  the  modified  G-spectral  estimator  given  in 
Definition  3  is  equivalent  to  an  ARMA  spectral  estimator.  To  facilitate 
the  discussion  we  make  the  following  definition. 


Definition  4.  Let  pCj)  be  the  sample  autocorrelation  estimator  for  p(j) 

A  A 

and  let  ^*^®  solution  to  the  equations 

A  A  A 

p(m+l)  ®  itjp(m)  +...+  p(m-n+l) 


p(m*n) 


#jp(m+n-l)  +  ..  .+(^^p(m). 


(4) 
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Then  let  solution  to  the  equations 

p(t)  =  pC^>  ^  ~  l,,..,in  (5) 

where 

p(^»  ^l*"***^Bi^ 

is  the  autocorrelation  function  of  the  ARMA  Cn,m)  process  with  parameters 
'^l’"'’^n  uniqueness,  we  require  that  the  solution  to 

(5)  be  such  that  the  resulting  ARMA  process  is  invertible  (i.e.,  the  roots 
of  e(r)  =  l-6j^r-02  r^  -  •••-0^r^  =  0  are  outside  the  unit  circle).  We  then 
call  the  spectral  density  of  the  above  estimated  ARMA  process 

®>  A  A  A  «. 

Sjj  j^Coi)  =  I  exp(2wiu)j)  p(j;  , . . .  0j,...,0J 

jzs-o. 


|0(exp(2irio)))  |  ^ 

^  Si _ 

I(Kexp(2TrioD))l^ 

the  order  (n,m)  method  of  moments  ARMA  spectral  density  estimator. 

In  the  above  definition  it  was  tacitly  assumed  that  a  solution  to  (4) 
and  (5)  exists  which  corresponds  to  a  stationary  ARMA  (n,m)  process.  How- 

A 

ever,  for  m  >  0,  even  if  p(j)  is  positive  definite,  that  need  not  be  the 
case.  The  solution  to  (4)  may  have  a  characteristic  equation  with  roots 
inside  the  unit  circle  and  there  may  exist  no  solution  to  (5)  at  all.  In 


that  case,  we  say  that  the  method  of  moments  spectral  estimator  is  undefined. 
The  relationship  between  the  two  spectral  estimators  is  as  follows. 


Theorem  2.  Let  G  fu)  and  s  _Cw)  be  as  defined  above  and  suppose  that 

n^m  riyiii 

A 

s _ (w)  exists.  Then 

n,m 

A 

G_  „(<»)  5  s  (ui)  . 
n,in  n,iB 
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That  is  ^(u)  is  an  ARMA  spectral  estimator  which  avoids  the  computation 
of  the  moving  average  parameter  estimates. 


Proof.  It  is  immediate  from  the  definition  that 

A  A  A  A  A 

p(jl)  =  p(t;  <(»  ,  8  ,...,0  ),  I  =  1,...,  m+n. 

1  n  X  m 

A  A  A  A 

Further  {pfA;  ,  0,,...,0  )}  is  an  element  of  L(n,m,A).  The  result 

1  n  1  m 

then  follows  from  equation  (3). 

The  above  theorem  also  provides  an  alternative  means  of  calculating 
the  method  of  moments  parameter  estimates  utilizing  the  so-called  inverse 
autocorrelations  introduced  by  Cleveland  [3].  In  particular  we  have  the 
following  easily  proved  result. 


Theorem  3.  Let  ,  0,,....8 

1  n  1  m 

A 

suppose  that  s  (oi)  exists.  Then  if 
nf  m 


and  G  (w) 

njm*-  ^ 


be  as  defined  above  and 


.5 


ciCk)  =  /■  S°?.(2jtW  ^  ^ 

0 


n,m 


0, , ....  0  are  the  solutions  to 
1  n 


(6) 


ci(n+l)  »  9^ci(n)  ©  ci(n-m+l) 

:  (7) 

ci(n+m)  =  0j^ci(n+m-l)  +  ••+  e^ciCn). 

A  A 

The  above  procedure  for  calculating  provides  a  better 

numerical  procedure  than  the  usual  non-linear  scheme  (where  (6)  is  approxi¬ 
mated  by  Simpson's  Rule  for  instance).  The  solution  to  (7)  is  unique  and 
ensures  that  an  invertible  solution  will  be  obtained.  Further  details 
will  appear  in  a  later  paper  by  Moi^on. 

Since  the  spectral  estimator  in  Definition  3  is  an  ARMA  spectral 
estimator,  when  the  latter  exists  the  former  is  non-negative.  However, 
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since  G  (ui)  may  exist  when  s  (oi)  does  not,  it  need  not  always  be 
w  ^  ni  n  ^  in 

non-negative.  It  is,  in  that  case,  natural  to  consider  shifting  the 
estimator  upward  or  truncating  it  from  below.  Two  methods  for  shifting 
the  estimator  upward  are  contained  in  the  following  theorem.  Their  relative 
merits  are  unclear,  but  the  second  estimator  seems  more  intuitively  appealing. 
The  second  estimator  has  the  additional  virtue  of  providing  initial  "estimates" 

A  A 

(using  Theorem  3  on  the  "shifted"  spectrum)  for  when  no  solution 

to  the  equations  in  (5)  exists. 

A 

A 

Theorem  4.  Let  G_  _(a))  and  be  as  defined  above  and  let  C,  and  C« 

-  n,m  In  12 

be  constants  (possibly  depending  on  the  data)  such  that 


where 


and 


(a)  Sj((u)  =  +  C^)  ^  0 

(b)  82(10)  =  k2(G^^Ja.)  *  C2/U(e^’'^“)|2)  >  0 

"  2Tri(o.  ,  ?  2iria)  '  ;;;  ^2triu 

and  k2  are  chosen  such  that 

.  5  ..  .5a 

/  s,(o))do)  =  /  s_((o)dw  =  1, 

-.5  ^  -.5  ^ 


Then  Sj(u)  is  the  spectral  density  of  an  ARMA(n,)lj)  process  where 

£  max(n,m)  and  82(01)  is  the  spectral  density  of  an  ARMA(n,A2)  process 
where  ^2  i  ®* 


Proof.  It  is  straightforward  to  show  that 


in  ^  . 

I 


j=-m 


^  _2TTiun| 
e  -•••-Ae 

^n  ' 


J 
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where  the  a.  are  real  and  a  . 

J  -2 


a. . 
3 


Thus  is  of  the  form 


|lb  e2«<-j 


?  ^2iri(»)ni 


2 


>  0 


and  the  result  follows  since 

X 

[8]  p.  14).  The  result  for  S2(w)  follows  similarly. 

As  a  final  point,  we  make  the  observation  that  the  autoregressive 
parameters  need  not  be  calculated  in  order  to  calculate  the  G-spectral 
estimator.  The  calculation  can  be  made  using  the  so-called  e-algorithm 
introduced  by  Wynn  [12].  However,  the  calculated  coefficients  themselves 
provide  meaningful  information  and  more  importantly  offer  a  more  efficient 
method  for  calculating  the  G-spectral  estimator  using  the  following  result. 


*'1  2  i  ■ 

J  b.e  ^  can  then  be  factored.  [See  Hannan 


A  A 

Theorem  5.  Let  . . .  ,<|)^  be  as  given  in  Definition  4  and  let 

j 

A 

f.  =  p(j)  exp(27riu)j),  F  =  J  f  , 

^  •'  i.*-k 


a.  =  exp(27riu)j) . 


Then 


G  „(u)  =  2  Real 
n,m 


F  ,-o,  F  - 
m+1  1  m 


-a  F  , 
n  m-n+1 


-F. 


L 


1  -a, -•'•-a 
1  n 


+  1. 


C8) 


Proof.  By  elementary  column  operations,  we  have  that 


e  (Fm)  = 

n  m' 


''m.i  -  °i''. . “i. 

. “n 


and  the  result  follows. 

As  a  more  contact  formula,  we  may  let  s^  =  Fj  ■  Fq  * 


becomes 


G  (u)  *  2  Real 
n  ,m 


s  ,  -  o,  s  •  •-0  s 
m+1  1  m  n  m-n+1 


1-v 
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If  f  is  the  number  of  frequencies  at  which  the  spectrum  is  calculated, 

2 

the  method  using  the  e-algorithm  requires  roughly  Sfn  operations  while  the 
method  using  (8)  requires  roughly  n^/3  operations.  Taking  f  =  100,  for 
instance,  the  break-even  point  is  just  less  than  n  =  1300,  a  much  higher 
order  autoregressive  operator  than  is  ever  used  in  practice. 

Examples 

In  this  section,  the  performance  of  the  spectral  estimator  introduced 
in  Definition  3  is  investigated  on  several  simulated  data  sets.  For  compa¬ 
rison  purposes,  an  autoregressive  spectral  estimate  and  a  Parzen  window 
spectral  estimate  are  also  calculated.  The  order  of  the  autoregressive 
operator  to  be  used  in  the  autoregressive  estimator  is  chosen  according  to 
the  minimum  FPE  criterion  of  Akaike  [1].  The  window  spectral  estimator  will 
be  calculated  using  15%  of  the  sample  autocorrelations. 

Example  1.  The  first  example  we  consider  is  a  realization  of  length  200 
from  the  MA(33  process 

The  true  log  spectral  density  for  the  above  process  is  given  in  Figure  1. 

The  first  10  sample  autocorrelations  are  given  in  Table  2,  and  the 

process  is  identified  rather  easily  as  a  third  order  moving  average  process. 

The  Gq  jCo))  spectral  estimate  (which  here  simply  reduces  to  the  finite 

3  A 

Fourier  transform  1  +  2  p  (j)cos(2iruj))  is  given  in  Figure  2. 

j=I 

The  minimum  FPE  criterion  chooses  a  ninth  order  autoregressive  model 
for  this  data  set.  The  estimated  AR(9)  spectral  density  is  given  in  Figure 
3.  The  numerous  false  peaks  shown  there  is  typical  for  an  autoregressive 
fit  to  a  moving  average  spectral  density,  esfiecially  near  the  non-invertible 
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region. 

The  Parzen  window  spectral  estimate  using  30  autocorrelations  is  given 
in  Figure  4  and  is  somewhat  similar  to  the  autoregressive  spectral  estimate. 

Example  2.  We  now  consider  a  realization  of  length  400  from  the  ARMA(2,4) 
process 

The  true  spectral  density  for  the  above  process  is  given  in  Figure  5. 

The  sample  S-array  for  this  series  is  given  in  Table  3,  and  the  correct 
order  is  easily  identified.  The  G2  spectral  estimate  is  shown  in 

Figure  6. 

The  FPE  criterion  chooses  an  AR(9)  model.  The  corresponding  auto¬ 
regressive  spectral  estimate  is  shown  in  Figure  7.  We  note  that  the  inter¬ 
mediate  hump  shows  through  only  very  poorly. 

In  Figure  8,  the  Parzen  window  spectral  estimate  using  60  autocorrela¬ 
tions  is  given.  It  also  does  not  show  the  intermediate  hump  as  clearly  as 
the  G2  ^(u)  estimate  and  gives  a  false  peak  for  u  slightly  larger  than  .4. 

Example  3.  This  example  illustrates  some  of  the  robustness  properties  of 
the  spectral  estimator  being  investigated.  The  example  is  a  realization  of 
length  30  from  the  signal-plus-noise  model 

=  /20  cos(.2Tr  +  'll)  +  a^ 

where  is  a  variance  1  white  noise  random  sequence  and  U(0,2ir). 

The  true  spectrum  is  shown  in  Figure  9,  where  the  spike  indicates  a 
Dirac  delta  function. 

The  sample  S-array  is  given  in  Table  4.  A  second  order  auto¬ 
regressive  operator  appears  to  be  called  for,  but  it  is  unclear  which 
order  moving  average  operator  is  most  appropriate.  A  moving  average 


order  of  1  and  3  both  give  negative  spectral  estimates.  Tlie  G-  -(to) 
estimate  is  given  in  Figure  10.  The  peak  is  rather  clearly  shown 
and  the  estimate  is  quite  flat  off  the  peak. 

FPE  was  minimized  for  this  example  using  an  AR(5)  model.  The  5th 
order  autoregressive  spectrum  is  given  in  Figure  11.  This  estimate  also 
gives  good  resolution  of  the  peak,  however,  it  is  not  as  flat  off  the  peak 
as  the  G2  estimate. 

Finally  we  show  the  Parzen  window  spectral  estimate  using  5  auto¬ 
correlations.  The  bias  of  the  window  estimator  for  short  data  sets  is 
apparent  as  there  is  no  indication  of  a  peak  at  all. 

Example  4.  Our  last  example  illustrates  what  we  feel  is  an  important  point. 
Namely,  that  when  filtering  is  necessary  to  identify  the  complete  model, 
the  spectrum  should  be  estimated  in  a  "piecewise"  manner  as  we  illustrate 
below. 

The  example  is  a  realization  of  length  300  from  the  ARMAC2,4)  process 

t  t-1  t-2  t  t-1  t-2  t-3  t-4 

model  is  similar  to  that  of  Example  2  except  that  the  roots  of  the  charac¬ 
teristic  equation  are  nearer  to  the  unit  circle  and  the  moving  average 
operator  is  further  from  the  non-invertibility  region.  The  true  spectral 
density  is  shown  in  Figure  13. 

The  sample  S-array  is  given  in  Table  5.  The  near  constancy  in  the 
second  column  of  the  S-array  indicates  a  second  order  near  non-stationarity 
(see  Gray,  Kelley  and  Mclntire  [7]).  The  estimated  transformation  to 
stationarity  (from  the  sample  Yule-Walker  equations  adjusted  for  frequency) 
is  (1  -  1.68B  +  .948^) . 

The  first  10  autocorrelations  of  the  transformed  series  are  given  in 
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Table  6.  The  residual  series  is  then  identified  very  easily  as  an  MA(4) 
process  and  the  series  is  thus  modeled  as  an  ARMA(2,4)  process. 

The  spectral  estimate  is  given  in  Figure  14.  The  estimate 

is  rather  disappointing  in  that  it  shows  no  hump  at  the  intermediate 
frequencies.  The  reason  for  that,  recalling  Theorem  2,  is  that  the  method 
of  moments  estimate  for  the  moving  average  parameters  here  is  quite  poor 
(see  Table  7).  For  comparison  purposes,  we  calculated  the  maximum  likeli¬ 
hood  estimate  for  the  parameters  (see  Table  8).  That  estimate  is  a  consi¬ 
derable  improvement  over  the  method  of  moments  estimate  as  is  the  accom¬ 
panying  spectral  estimate  (see  Figure  IS). 

Actually,  the  direct  calculation  of  G2  ^(w)  is  not  what  we  would  have 
recommended  from  the  start.  That  is,  in  view  of  the  Findley-Quinn  theorem 
(see  [10])  it  is  clear  that  the  estimate  for  the  moving  average  coeffi¬ 
cients  must  be  poor  if  one  is  sufficiently  close  to  the  non- stationary 
region.  The  domination  of  the  autoregressive  operator  near  the  non¬ 
stationary  region  is  clearly  demonstrated  in  GKM  [7] .  The  whole  problem 
can  easily  be  avoided  by  transforming  to  stationarity,  i.e.,  prefiltering. 
The  approach  we  now  investigate  as  an  alternative  to  obtaining  the  maximum 
likelihood  estimate  is  similar  to  the  pre-filtering  procedure  of  Tukey. 
First  estimate  the  second-order  autoregressive  operator  from  the  Yule- 

Walker  equations  associated  with  an  ARMA  (2,4)  model.  The  estimated 

2 

operator  is  1  -  1.65B+  .91B  .  Then  transform  by  the  estimated  operator 
and  estimate  the  spectrum  of  the  residual  series  by  the  G^  ^(u)  estimate. 
The  resulting  spectral  estimate  is  then  s((d)  given  by 

-2 

S(u)  *  K|1-1.65  exp(2Tri{i>)  +  .91  exp(4iTia))  |  Gq  ^(m). 
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where  K  is  chosen  so  that 
.5  . 

/  S(u)dtD  =  1. 

-.5 

The  spectral  estimate  using  the  above  procedure  is  given  in  Figure 
16.  It  compares  favorably  with  the  maximum  likelihood  estimate  and  is 
actually  slightly  better  in  an  sense  for  this  particular  example.  It 
is  also  far  easier  to  calculate  than  the  maximum  likelihood  estimate. 

FPE  is  minimized  using  a  5th  order  autoregressive  operator.  That 
spectral  estimate  is  given  in  Figure  17.  It  appears  similar  to  the  initial 
G2  ^(id)  estimate,  showing  no  hump  at  the  intermediate  frequency  (using  the 
maximum  likelihood  estimate  for  this  model  shows  no  real  improvement) . 

Finally,  the  Parzen  window  spectral  estimate  using  45  autocorrelations 
is  given  in  Figure  18.  The  estimate  is  similar  to  the  autoregressive 
estimate,  but  does  not  resolve  the  peak  quite  as  well. 

Summary  and  Discussion 

In  this  paper  we  have  defined  a  modified  version  of  the  so-called  G- 
spectral  estimator  introduced  by  Gray  [5] .  We  showed  that  the  modified 
G-spectral  estimator  is  an  extension  of  a  method  of  moments  ARMA  spectral 
estimator.  Moreover  when  this  method  of  moments  ARMA  spectral  estimator 
exists,  the  G-spectral  estimator  is  equivalent  and  does  not  require 
calculation  of  the  moving  average  parameters. 

We  feel  that  the  primary  virtues  of  this  spectral  estimation  procedure 
are  the  inherent  flexibility  of  the  ARMA  model  over  the  AR  model  and 
the  spectral  estimator's  computational  simplicity.  The  G-spectral 
estimator  presented  here  furnishes  a  closed  form  expression  for  the 
method  of  moments  ARMA(p,q)  a  spectral  estimator,  even  though  no  closed 
form  solution  exists  for  the  method  of  moments  estimate  of  the  moving 
average  parameters.  This  is  important  from  a  theoretical  and  a 
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practical  perspective  and  is  currently  being  exploited  by  the  authors 
in  a  number  of  areas. 

The  primary  difficulty  of  the  procedure  is  that  the  method  of  moments 
estimate  of  the  moving  average  parameters  is  often  not  very  good.  That 
difficulty  can  frequently  be  mitigated  however,  by  the  prefiltering 
procedure  described  in  Example  4. 


table  1 


Theoretical  S-Array  for  ARMA(p,q3  process. 
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TABLE  2 

1 _ 2 _ 3 _ 4 _ ^ 

-.71  .48  -.24  .01  -.04 

6 _ 7 _ 8 _ 9 _ ^ 

.01  -.05  .01  .00  -.02 


1st  10  sample  autocorrelations  for  Example  1.1 


TABLE  3 


S2 

S3 

S4 

S5 

.41 

-.29 

.02 

-.46 

.41 

-.71 

.45 

-.59 

.41 

-.21 

-11.24 

4.22 

.41 

16.44 

-7.86 

-5.64 

.35 

.12 

-.08 

.03 

.28 

.09 

.06 

.64 

.23 

.06 

-.68 

.88 

.20 

.23 

-.46 

2.19 

.18 

-.10 

.08 

-.08 

.19 

-.04 

.06 

-.13 

.21 

-.06 

.03 

.46 

.25 

—  ♦ 

-.07 

-.50 

.15 

.29 

4- 

-.28 

.28 

-.28 

.29 

.31 

.67 

.78 

.29 

-.68 

1.29 

-.06 

.29 

.74 

.02 

-.67 

Sample  S-Array  for  Example  2 

•Constancy  from  these  points  on  implies  ARMAC2,4) 


TABLE  4 
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SI 

S2 

S3 

S4 

S5 

S6 

-7 

1.722 

.372 

-.296 

.838 

-2.538 

1.293 

-6 

.299 

.399 

-1.179 

1.094 

.030 

-.850 

-5 

-.144 

.375 

-1.049 

5.823 

.838 

-1.191 

-4 

-.544 

.350 

-.755 

-.505 

-7.376 

6.851 

-3 

-1.720 

.426 

-1.059 

4.628 

-7.046 

25.049 

-2 

2.167 

.243 

-2.025 

-2.669 

-5.507 

-17.620 

-1 

.448 

.933 

-1.443 

2.892  ■ 

-3.858 

6.868 

0 

-.309 

.462 

.680 

.890 

-1.157 

1.391 

1 

-.684 

.240 

-.446 

.289 

-.610 

.500 

2 

-2.389 

.393 

•  -.509 

.905 

-.656 

.841 

3 

1.192 

.304 

-.698 

.225 

-.605 

-21.266 

4 

.169 

.375 

-.562 

.646 

-1.628 

.226 

S 

-.230 

■  .361 

-.530 

-12.943 

-.067 

4.528 

6 

-.633 

.351 

1.011 

2.4SS 

-4 . 366 

4.265 

Sample  S-array  for  Example  3  =  D(m) 
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TABLE  5 


SI 

S2 

S3 

S4 

-7 

-1.972 

3.985 

-13.810 

29.307 

-6 

-1.721 

3.992 

.907 

-2.805 

-5 

-1.321 

3.986 

2.555 

-20.639 

-4 

.641 

3.991 

-17.473 

20.799 

-3 

-3.566 

3.989 

-9.757 

16.537 

-2 

-2.444 

3.958 

-7.687 

-49.474 

-1 

-2.115 

3.912 

-20.561 

-20.285 

0 

-1.897 

3.684 

-4.487 

3.675 

1 

-1.692 

3.634 

-7.399 

5.227 

2 

-1.390 

3.589 

-6.039 

11.284 

3 

-.380 

3.570 

-4.626 

8.715 

4 

-4.119 

3.570 

-1.393 

.754 

5 

-2.387 

3.567 

-.661 

7.425 

6 

-2.029 

3.572 

-5.024 

4.873 

Sample 

S- array  for  Example  6 

^m  * 

TABLE  6 


.79  ,57  .38  .20  .01  .00  .02  ,01  .03 


.08 


1st  10  autocorrelations  from  the  residual  series  of  Example  4 


1 


TABLE  7 


«  1.65  $2  ®  -.91 

9j  »  .036  §2  =  -.26  =  -.20  0^  =»  -.14 
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Method  of  Moments  Parameter  Estimates  for  Example  4 


TABLE  8 
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=  1.66  ^2  “ 

9^  =  -.92  ^2  * 


Maximum  Likelihood  Parameter  Estimates  for  E.xample  4 


FIGURE  3 


LOGARITHM  OF  THE  ARC9)  SPECTRAL  ESTIMATE  FOR  EXAMPLE  1 


Log  Spec 
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FIGURE  6 
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*  ESTIMATE  FOR  EXAMPLE  2 


0 


.1 


.  2 

Frequency 


.5 


I  \ 

.3  .4 


LOGARITHM  OF  THE  PARZEN  WINDOW  SPECTRAL 
ESTIMATE  FOR  EXAMPLE  2 


FIGURE  11 
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ESTIMATE  FOR  EX.AMPLE  3 


FIGURE  12 
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LOGARITHM  OF  THE  TRUE  SPECTRAL 
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